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Abstract 

The Parameter-less Genetic Algorithm was first presented by Harik and Eobo in 1999 as 
an alternative to the usual trial-and-error method of finding, for each given problem, an accepf- 
able set-up of the parameter values of the genetic algorithm. Since then, the same strategy has 
been successfully applied to create parameter-less versions of other population-based search 
algorithms such as the Extended Compact Genetic Algorithm and the Hierarchical Bayesian 
Optimization Algorithm. This report describes a Java implementation. Parameter-less Evolu¬ 
tionary Algorithm (P-EAJava), that integrates several parameter-less evolutionary algorithms 
into a single platform. Along with a brief description of P-EAJava, we also provide detailed 
instructions on how to use it, how to implement new problems, and how to generate new 
parameter-less versions of evolutionary algorithms. 

At present time, P-EAJava already includes parameter-less versions of the Simple Ge¬ 
netic Algorithm, the Extended Compact Genetic Algorithm, the Univariate Marginal Dis¬ 
tribution Algorithm, and the Hierarchical Bayesian Optimization Algorithm. The source 
and binary files of the Java implementation of P-EAJava are available for free download at 
https://github.eom/JoseCPereira/2015ParameterlessEvolutionaryAlgorithmsJava 


1 Introduction 


The parameter-less genetie algorithm (P-GA) was first presented by [Harik and Lobo (19991 as an 
alternative to the usual trial-and-error method of finding, for eaeh given problem, an aeeeptable 
set-up of the parameter values of the genetie algorithm. 

Shortly after, |Pelikan and Lobo| ( |1999| ) showed that, even in the worst-ease seenario, the total 
number of funetion evaluations performed in one run of the P-GA does not inerease signifieantly 
with respect to the number of function evaluations performed by the standalone GA tuned with an 
optimal fixed population size. Moreover, the authors pointed out that the worst-case scenario was 
extremely improbable to occur and that the expected performance of the P-GA in practice should 
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be much more benevolent. Therefore, [Pelikan and Lobo| ( |1999[ ) concluded that the P-GA is an 
efficient method of eliminating the parameters of the simple GA . 

Since then, the same strategy has been successfully applied to develop other parameter-less evo¬ 
lutionary algorithms such as the Parameter-less Extended Compact Genetic Algorithm (P-ECGA) 
(|Eobot 20001, the Parameter-less Genetic Programming Algorithm (P-GPA) (Spinosa and Pozol 


20021, and the Parameter-less Hierarchical Bayesian Optimization Algorithm (P-HBOA) (Pelikan 


et al.[ 2007). Building on these results, we implemented in Java the Parameter-less Evolutionary 


Algorithm (P-EAJava) that integrates several parameter-less evolutionary algorithms into a single 
platform. 

At present time, P-EAJava already includes the P-GA, the P-ECGA, the P-HBOA, and a 


parameter-less version of the Univariate Marginal Distribution Algorithm (Muhlenbein and PaaB 


19961. The source and binary files of the Java implementation of P-EAJava are available for free 


download at https://github.eom/JoseCPereira/2015ParameterlessEvolutionaryAlgorithmsJava, 

The P-EAJava uses as a common working base the standard versions of the Simple Genetic Al¬ 
gorithm ( [Holland , 1975[ Goldberg 1989; Eiben and Smith 2003| ), the Univariate Marginal Distri¬ 


bution Algorithm ( 


Muhlenbein and PaaB 19961, the Extended Compact Genetic Algorithm (Harik 


1999), and the Hierarchical Bayesian Optimization Algorithm (Pelikan and Goldberg[ 2006). The 


Java implementation of these four standard EAs is presented in detail in another arXiv report 
from the same authors. The corresponding source code is also available for free download at 


https://github.eom/JoseCPereira/2015Evolutionary Algorithms Java , 

The remainder of this paper is organized as follows. In Section]^ we briefly describe the main 
concepts of the P-GA that are the basis for the P-EAJava implementation. In Section we discuss 
the P-EAJava implementation itself and provide detailed instructions on how to use it, how to 
implement new problems with it, and how to generate new parameter-less versions of evolutionary 
algorithms. 


2 The Parameter-less Genetic Algorithm 


The P-GA establishes an evolutionary race among an unbounded number of independent popula¬ 
tions. All populations are evolved using the same simple GA which has most of its parameters set 


a priori to robust fixed values, in accordance with facetwise theoretical studies ( [Goldberg et al.[ 
1993[ Thierens and Goldberg[ 19931. The only exception is the population size which is dynami¬ 
cally adapted using a population sizing method. 

In the P-GA each independent population is uniquely identified by its size, Ni. This size doubles 
between consecutive populations, according to the identity 


M = 2'Ao, V/gIN 


( 1 ) 


where Nq is the initial population size, chosen to be a small enough value such as Aq = 10. 

The P-GA starts by performing 4 generations of population Nq, after which it evolves popu¬ 
lation N\ for a single generation. This process is then repeated so that, for each 4 generations 
performed with population Nq, there will be one generation performed with population N\ . The 
same evolutionary procedure is used recursively for all other populations so that, throughout the 
entire run of the algorithm, for each 4 generations performed with population A, there will be 
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Figure 1: The P-GA establishes a race among an unbounded number of populations with expo¬ 
nentially increasing size that are evolved using a simple GA. For each 4 generations performed 
with population 2Wo there will be one generation performed with population The initial 

population size Nq is chosen to be a small enough value such as No = 10. 


one generation performed with population A/+i. Figure depicts a graphical representation of a 
possible instance of this population evolution. 

The P-GA works under the assumption that solution quality grows monotonously with the 
population size (Lobo and Lima, |2007| ). In addition, the algorithm also assumes that this improve¬ 
ment in solution quality happens at a decreasing rate, i.e., when the same increase in population 
size happens between larger and larger populations, the gains in solution quality are expected to 
be fewer and fewer. For these reasons, the evolutionary race is established between populations 
with exponentially increasing size. Simultaneously, the P-GA allows smaller populations to use 
more computational resources, because if two different populations produce solutions with similar 
quality then the smaller population should be preferred, all other things being equal. 

In their paper, Harik and Lobo (19991 used a counter of base 4 to implement the population siz¬ 
ing method of the P-GA (see also, Lobo (2000); Pelikan and Lobo| ( |1999| ) for detailed descriptions 
of this counter). However, Pelikan et al. (20071 suggested a somewhat simpler implementation for 
that sizing method and used it to propose a parameter-less version of the HBOA. The same sim¬ 
pler implementation was adopted to develop the work reported in this paper. Figure [^depicts the 
pseudocode for the population sizing method as presented by Pelikan et al, where only the name 
in the title had to be changed to make it work for the simple genetic algorithm. 

In the P-GA, the performance of a population at any point in time is measured by the current 
average fitness of all its individuals and by how many resources it has consumed, i.e., by how many 
fitness function evaluations it has already performed. Naturally, a population that has consumed 
more resources is expected to have a better fitness than any other population that has performed 
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P-GA POPULATION SIZING METHOD 


1 initialize population[0] with size Nq 

2 generation[0] ^ 0 

3 max-initialized ^ 0 

4 i ^ 0 

5 while (not done) 

6 do evolve population[^\ one generation 

7 generation[i\++ 

8 if {generation[i\ mod 4 = 0) 

9 then i++ 

10 if (i > max-initialized) 

11 then initialize population^ with size 2*7Vo 

12 max-initialized <r- i 

13 else i ^ 0 

Figure 2: Pseudocode for the population sizing method employed by the P-GA. 


less fitness evaluations. When this is not the case, the more costly populations should be discarded. 
In practice, whenever population Ni obtains an average fitness at least as good as the average fitness 
of population Ni-\, the P-GA eliminates all smaller populations with k < i. Note that, strictly 
speaking, the P-GA could maintain active those smaller populations that eventually still have a 
better fitness than Np However, if Ni has already caught up with it will definitely catch 
up with all other smaller populations, rather sooner than later. Therefore, it is more efficient not 
to waste any more time with these populations and focus all resources on those populations that 
promise to deliver better quality solutions. 

For the sake of simplicity the P-GA employs a genetic algorithm without a mutation operator. 
In the absence of mutation, all individuals in a population eventually become identical. In such 
a state, the population is said to have converged and can no longer generate any new individuals 
and will not improve its average fitness. In this case, the P-GA stores the information concerning 
the best solution found and eliminates not only the converged population, but all other smaller 
populations. This is efficient and effective, because once a population has converged, all smaller 
populations will also converge in the near future, and since solution quality increases along side 
with population size, there is nothing to gain by waiting for them to do so. 

The P-GA is designed to run forever, physical constraints aside, because in practice the quality 
of the optimal solution is often unknown for many problems, making it impossible to distinguish, 
for instance, when the algorithm has reached the optimum result from when it simply got “stuck” 
in some plateau of the search space. Therefore, the P-GA leaves to the user the decision when 
to stop the computation, based on the quality of the solutions already found and on the time and 
resources that she or he is willing to spend. 

With an ever increasing set of larger and larger populations, the P-GA would soon exhaust all 
computational resources available. By discarding populations that either do not comply with the 
parameter-less invariant or can no longer improve the quality of its solutions, the P-GA ensures 
that the actual number of active populations, although unbounded, will not grow excessively large 
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with time. In fact, this discarding process, which is more intensive for smaller populations, is one 
of the main factors behind the relatively small amount of extra computational resources that the 
P-GA requires in relation to the standalone GA working with an optimal fixed population size. 


The implementation of a parameter-less version of the HBOA by Pelikan et al. (20071 showed 
in practice that the parameter-less strategy proposed by [Harik and Lobo (1999) was not tied to a 
specific evolutionary algorithm. The same result had also been shown by Lobo| ( |2000[ ) with the 
implementation of the P-ECGA which was used by the author to solve an electrical network ex¬ 
pansion problem. Likewise, Pelikan et al.| ( |2007 ) used the P-HBOA to successfully solve artificial 
hierarchical and nearly decomposable problems, and a 2D version of the real world Ising Spin 
Glasses problem. In the next section, we describe how to use the P-EAJava. 


3 The Parameter-less Evolutionary Algorithm 

The Parameter-less Evolutionary Algorithm (P-EAJava) is a Java implementation of the population 
sizing method employed by the P-GA (see Eigure]^. However, by decoupling the population sizing 
method from the evolutionary algorithm itself, the P-EAJava allows the creation of parameter-less 
versions of other evolutionary algorithms in a straightforward manner. 

Naturally, the P-EAJava works with algorithms for which it is reasonable to presume the same 
assumptions as the simple GA, namely that solution quality grows monotonously with the popu¬ 
lation size, but at a decreasing rate and that it is possible to effectively automate the adaptation 
process of all the algorithm’s parameters, with the possible exception of the population size. 

At present time, an evolutionary algorithm must satisfy the following set of constraints in order 
to be integrated in the P-EAJava: 

1. The algorithm represents possible solutions (individuals) as strings of zeros and ones. 

2. All individuals have the same string size. 

3. The population size remains constant throughout a complete run of the algorithm. 

Naturally, it should be possible to further generalize the P-EAJava and eliminate or at least 
weaken such constraints. 

3.1 How to use the P-EAJava 

The P-EA is a Java application developed with the Eclipse^ IDE. The available code is already 
compiled and can be executed using the command line. 

Run the P-EAJava from a command line 

1. Unzip the source file 2015ParameterlessEAs.zip to any directory. 

'Version: Kepler Service Release 2 
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2. Open your favourite terminal and execute the command 

cd [yourDirectory]/2015ParcLmeterlessEvolutionaryAlgorithmsJava/bin 

where [yourDirectory] is the name of the directory chosen in step 1. 

3. Execute the command 

java coni/z_PEA/PARAMETERLESS ./PEAParameters . txt 

The argument “PEAParameters.txt” is in fact the name of the file containing all the options 
concerning the P-EA settings and can be changed at will. 

After each execution of a single or multiple runs, the P-EAJava produces one output file - 
PARAMETERLESS-*-*.txt - that records how each run progressed in terms of population size, 
best current fitness, among other relevant information. Additionally, the P-EAJava also creates the 
file - PARAMETERLESS-STATS * *.txt - that stores some of the statistics necessary for analyzing 
the behaviour of the parameter-less algorithms over multiple runs. 

At present time, the P-EAJava version made available with this paper already includes four 
parameter-less algorithms: 

• Parameter-less Genetic Algorithm, 

• Parameter-less Univariate Marginal Distribution Algorithm, 

• Parameter-less Extended Compact Genetic Algorithm, 

• Parameter-less Hierarchical Bayesian Optimization Algorithm 

The current code also includes a set of test problems that can be solved using some or all of 
the previous algorithms. Here is the problem menu: 

ZERO Problems ONE Problems 


0^ 

ZeroMax 

10-^ 

OneMax 

1 ^ 

Zero Quadratic 

11 ^ 

Quadratic 

2-^ 

Zero 3-Deceptive 

12^ 

3-Deceptive 

3 ^ 

Zero 3-Deceptive Bipolar 

13 

3-Deceptive Bipolar 

4^ 

Zero 3-Deceptive Overlapping 

14^ 

3-Deceptive Overlapping 

5 ^ 

Zero Concatenated Trap-k 

15 ^ 

Concatenated Trap-k 

6 ^ 

Zero Uniform 6-Blocks 

16^ 

Uniform 6-Blocks 

Hierarchical Problems 



21 

Hierarchical Trap One 



22 

Hierarchical Trap Two 
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The Zero problems always have the string with all zeros as their best individual. The One 
problems are the same as the Zero problems but their best individual is now the string with all 
ones. A deseription of these problems ean be found, for instanee, in Pelikan et al. (2000). The 
Hierarehieal problems are thoroughly deseribed in Pelikan (20051. 

It is also possible to define a noisy version for any of the previous problems. This is done by 
adding a non-zero Gaussian noise term to the fitness funetion. 

The souree eode that implements all the problems mentioned in this seetion ean be found in the 
file src/com/z-PEA/Problem.java. 

As mentioned previously, all options eoneerning the parameter-less strategy are in the file 
PEAParameters.txt. In partieular, it is in this file that are made the ehoiees for the problem to 
be solved and for the parameter-less algorithm that is going to solve the ehosen problem. 

To ehoose a partieular problem the user must set the value of the following three options: 


Line 81: problemType 
Line 90: stringSize 

Line 107: sigmaK (defines the noise eomponent) 

Analogously, to ehoose a partieular parameter-less algorithm it is neeessary to set the values 
of the following two options: 

Line 125: eAlg 

Line 135: eaParamPile (defines the name of the eorresponding parameters file) 

All other options are set to default values and their role in the parameter-less strategy is 
explained with detail in the file’s eomments. This is also true for the parameters speeifie to eaeh 
of the implemented algorithms whieh are defined in four separate files: 

SGA: SGAParameters.txt 
UMDA: UMDAParameters.txt 
ECGA: ECGAParameters.txt 
HBOA: HBOAParameters.txt 

Note that the default settings defined in these three files were ehosen to ensure a robust behavior 
of the eorresponding algorithms, in aeeordanee with eurrent theory. Therefore, the user is advised 
to proeeed with eaution when performing any ehanges in those settings. In faet, the whole idea 
behind the parameter-less strategy is to eliminate the need of sueh fine tuning when solving a 
partieular problem. After ehoosing a problem to be solved and a partieular algorithm to solve it, 
the user has only to press the start button and wait until the P-EAJava finds a solution with good 
enough quality. 


3.2 How to implement a new problem with P-EAJava 

The P-EAJava uses the design pattern strategy ( [Gamma et al.[ |1995| ) to deeouple the implemen¬ 
tation of a partieular problem from the remaining parameter-less strategy (see Eigure |^. As a 
eonsequenee, to plug in a new problem to the framework it is only neeessary to define one elass 
that implements the interfaee IProblem and ehange some input options to inelude the new ehoiee. 
The interfaee IProblem ean be found in the file src/com/z-PEA/Problem.java. 
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Figure 3: The P-EAJava uses the design pattern strategy ( Gamma et ah 1995| to allow an easy 
implementation of new problems to be solved by the framework. 


In the following let us consider that we want to solve a new problem called NewProblem with 
one of the parameter-less algorithms. To plug in this problem it is necessary to: 

1. Define a class called NewProblem in the file src/com/z-PEA/Problem.java. The signature of 
the class will be 

class NewProblem implements IProblemf 

public float 
// 

} 

public String toStringC){ 
return "NEW PROBLEM"; 

} 

} 

2. Code the body of the function computeFitness(Individual) according to the nature of problem 
newProblem. The class Individual provides all the necessary functionalities to operate with 
the string of zeros and ones that represents an individual (e.g., getAllele(int)). This class can 
be found in the file src/com/z-PEA/Individual.java. 

3. To define the new problem option, add the line 

case 99: return new ProblemCnew NewProblem(), stringSize, optimumValue, sigma); 

to the switch command in line 209 of the file src/com/z-PEA/ParParameter.java. The case 
number - 99 - is a mere identifier of the new problem option. The user is free to choose 
other value for this purpose. The rest of the line is to be written verbatim. 

4. Validate the new problem option value - 99 - by adding the case problemType == 99 to the 
conditional in line 105 of the same ParParameter.java file. 
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Figure 4: General flowchart of a population-based search algorithm. The ParFrame can only inte¬ 
grate algorithms that follow this workflow. 


Although not strictly necessary, it is also advisable to keep updated the problem menu in the 
file PEAParameters. txt. 


3.3 How to create a new parameter-less algorithm with P-EAJava 

At present time, the P-EAJava is general enough to work with population-based algorithms that 
follow the workflow depicted in Figure As such, the framework already provides all the nec¬ 
essary classes that define the working notions of Population and Stop Criteria. The evolutionary 
algorithm has only to provide its own classes related with the operators responsible for the evolu¬ 
tion of the population in each generation. 


The P-EAJava also uses the design pattern strategy (Gamma et al. 19951 to decouple as much 


as possible the implementation of a search algorithm from the remaining parameter-less strategy 
(see Eigurej^. However, as expected, to create a new parameter-less algorithm is not as simple as 
plugging in a new problem. 

Eet us look at the example of the parameter-less SGA to better understand all the necessary 
steps. Note that, the reading of the following instructions is best complemented with a good anal¬ 
ysis of the corresponding source code. 


1. Define the class SGA that implements the interface lEAlgorithm. Here is the important part 
of this implementation: 

class 5.QA extends lEAlgorithmf 

//. .. 

public lEASolver nev^IEASolverCint currentN){ 
return new SGASolverCparamFile, currentN); 

} 

//. . 

} 

Note that, the function newIEASolverimi) has the return type lEASolver which is itself an¬ 
other interface. The class SGA is included in the file src/com/z-PEA/SGA.java. 

2. Define the class SGASolver that implements the interface lEASolver. This class includes the 
all-important function nextGeneration(), responsible for implementing the evolution of the 
population in each generation. Here is the main part of the implementation: 
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public boolean nextGeneration(){ 

SelectedSet selectedSet - selection.selectCcurrentPopulotion); 

Individual[] newindividuals - crossover. cross(selectedSet); 

mutation .mutateCney»Individuals); 

replacement . replaceCcurrentPopulation, newindividuals); 

currentGeneration+-f ; 

fitnessCalls +- newindividuals. length; 

currentPopulation. computeUnivariateFrequenciesC); 

avgFitness - currentPopulation. computeAvgFitnessC); 

return Stopper. criterio(currentGeneration, currentPopulation); 

} 

Note that, the funetion must return a boolean as the result of evaluating the stop eriteria. The 
elass SGASolver is ineluded in the file src/com/SGA/SGASolver.java. 

3. To define the new algorithm option, add the line 

case 0: return new SGA(eoPoromfiZe) ; 
to the switch eommand in line 241 of the file src/com/z-PEA/ParParameter.java. 

4. Validate the new problem option value - 0 - by adding the ease eAlg == 0 to the eonditional 
in line 139 of the same ParParameter.java file. 

In order to aehieve eomplete integration in the P-EAJava, the parameter-less SGA must also use 

the elasses provided by the framework that define, for instanee, the stop eriteria of the algorithm. 

Here is a brief deseription of those elasses: 

Population Contains the array of individuals that are the population. It provides all the fune- 
tionalities neeessary for operating that set of individuals. In partieular, it is responsible for 
eomputing its own average fitness, whieh is a erueial information for the parameter-less 
strategy. 

RandomPopulation Subelass of the elass Population. The eonstruetor of this elass is responsible 
for generating the initial random population. 

SelectedSet Subclass of the class Population. For some algorithms, depending on the selection 
operator, the size of this set is different from the population size. 

Individual Contains the string of zeros and ones that represents an individual. It provides all 
the functionalities necessary for operating that string. In particular, it is responsible for 
computing its own fitness, according to the problem at hand. 

Stopper Contains all the stop criteria used by the parameter-less algorithms. These criteria are 
integrated in a single function called criteria{...) which in turn must be returned by the 
nextGenerationO function (see step 2 of the SCA instructions). The criteria options can be 
changed in the file PEAParameters.txt 
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ParEngine 


♦ 


«interface» 

lEAlgorithm 

+newlEASolver() 




Figure 5: The P-EAJava uses the design pattern strategy (Gamma et al. 19951 to decouple as much 
as possible the implementation of a search algorithm from the remaining parameter-less strategy. 
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